Pandas Profiling Report

Dataset statistics

Number of variables	18
Number of observations	47926
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	13.1 MiB
Average record size in memory	287.5 B

Variable types

Numeric	13
Categorical	4
DateTime	1

Alerts

`name` has a high cardinality: 46963 distinct values	High cardinality
`host_name` has a high cardinality: 11425 distinct values	High cardinality
`df_index` is highly correlated with `id` and 1 other fields	High correlation
`id` is highly correlated with `df_index` and 1 other fields	High correlation
`host_id` is highly correlated with `df_index` and 1 other fields	High correlation
`neighbourhood_group` is highly correlated with `latitude`	High correlation
`latitude` is highly correlated with `neighbourhood_group`	High correlation
`room_type` is highly correlated with `price`	High correlation
`price` is highly correlated with `room_type`	High correlation
`number_of_reviews` is highly correlated with `reviews_per_month`	High correlation
`reviews_per_month` is highly correlated with `number_of_reviews`	High correlation
`df_index` is highly correlated with `id` and 1 other fields	High correlation
`id` is highly correlated with `df_index` and 1 other fields	High correlation
`host_id` is highly correlated with `df_index` and 1 other fields	High correlation
`number_of_reviews` is highly correlated with `reviews_per_month`	High correlation
`reviews_per_month` is highly correlated with `number_of_reviews`	High correlation
`df_index` is highly correlated with `id`	High correlation
`id` is highly correlated with `df_index`	High correlation
`room_type` is highly correlated with `price`	High correlation
`price` is highly correlated with `room_type`	High correlation
`number_of_reviews` is highly correlated with `reviews_per_month`	High correlation
`reviews_per_month` is highly correlated with `number_of_reviews`	High correlation
`df_index` is highly correlated with `id` and 1 other fields	High correlation
`id` is highly correlated with `df_index` and 1 other fields	High correlation
`host_id` is highly correlated with `df_index` and 1 other fields	High correlation
`neighbourhood_group` is highly correlated with `neighbourhood` and 2 other fields	High correlation
`neighbourhood` is highly correlated with `neighbourhood_group` and 2 other fields	High correlation
`latitude` is highly correlated with `neighbourhood_group` and 2 other fields	High correlation
`longitude` is highly correlated with `neighbourhood_group` and 2 other fields	High correlation
`name` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`id` has unique values	Unique
`number_of_reviews` has 9510 (19.8%) zeros	Zeros
`reviews_per_month` has 9510 (19.8%) zeros	Zeros
`availability_365` has 17464 (36.4%) zeros	Zeros
`month` has 2086 (4.4%) zeros	Zeros

Reproduction

Analysis started	2021-10-05 09:28:16.606406
Analysis finished	2021-10-05 09:29:01.507867
Duration	44.9 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
UNIQUE

Distinct	47926
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	24220.06001

Minimum	0
Maximum	48857
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	0
5-th percentile	2406.25
Q1	12051.25
median	24149.5
Q3	36208.75
95-th percentile	46428.75
Maximum	48857
Range	48857
Interquartile range (IQR)	24157.5

Descriptive statistics

Standard deviation	14061.80844
Coefficient of variation (CV)	0.5805852021
Kurtosis	-1.185390867
Mean	24220.06001
Median Absolute Deviation (MAD)	12079
Skewness	0.01948179953
Sum	1160770596
Variance	197734456.5
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2047	1	< 0.1%
40249	1	< 0.1%
19779	1	< 0.1%
17730	1	< 0.1%
23873	1	< 0.1%
21824	1	< 0.1%
42302	1	< 0.1%
48445	1	< 0.1%
46396	1	< 0.1%
36155	1	< 0.1%
Other values (47916)	47916	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
48857	1	< 0.1%
48856	1	< 0.1%
48855	1	< 0.1%
48854	1	< 0.1%
48853	1	< 0.1%
48852	1	< 0.1%
48851	1	< 0.1%
48850	1	< 0.1%
48849	1	< 0.1%
48848	1	< 0.1%

id
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
UNIQUE

Distinct	47926
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	18861822.12

Minimum	2539
Maximum	36487245
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	2539
5-th percentile	1185399
Q1	9386073.25
median	19475094
Q3	28834379.75
95-th percentile	35263722.75
Maximum	36487245
Range	36484706
Interquartile range (IQR)	19448306.5

Descriptive statistics

Standard deviation	10951890.59
Coefficient of variation (CV)	0.5806379956
Kurtosis	-1.218210411
Mean	18861822.12
Median Absolute Deviation (MAD)	9777786.5
Skewness	-0.07293591539
Sum	9.039716868 × 10¹¹
Variance	1.199439075 × 10¹⁴
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
11667455	1	< 0.1%
23560164	1	< 0.1%
28130741	1	< 0.1%
7851219	1	< 0.1%
34944655	1	< 0.1%
5229212	1	< 0.1%
22232269	1	< 0.1%
5581273	1	< 0.1%
20055242	1	< 0.1%
11801800	1	< 0.1%
Other values (47916)	47916	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2539	1	< 0.1%
2595	1	< 0.1%
3647	1	< 0.1%
3831	1	< 0.1%
5022	1	< 0.1%
5099	1	< 0.1%
5121	1	< 0.1%
5178	1	< 0.1%
5203	1	< 0.1%
5238	1	< 0.1%

Value	Count	Frequency (%)
36487245	1	< 0.1%
36485609	1	< 0.1%
36485431	1	< 0.1%
36485057	1	< 0.1%
36484665	1	< 0.1%
36484363	1	< 0.1%
36484087	1	< 0.1%
36483152	1	< 0.1%
36483010	1	< 0.1%
36482809	1	< 0.1%

name
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	46963
Distinct (%)	98.0%
Missing	0
Missing (%)	0.0%
Memory size	4.4 MiB

Hillside Hotel	18
Home away from home	17
New york Multi-unit building	16
Brooklyn Apartment	12
Loft Suite @ The Box House Hotel	11
Other values (46958)	47852

Length

Max length	179
Median length	36
Mean length	36.69745024
Min length	1

Characters and Unicode

Total characters	182
Distinct characters	1
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	46326 ?
Unique (%)	96.7%

Sample

1st row	Couch in Harlem Harvey Refugees only
2nd row	Beautiful room in Bushwick
3rd row	Quiet, Cozy UES Studio Near the Subway
4th row	Gigantic Sunny Room in Park Slope-Private Backyard
5th row	Jen Apt

Common Values

Value	Count	Frequency (%)
Hillside Hotel	18	< 0.1%
Home away from home	17	< 0.1%
New york Multi-unit building	16	< 0.1%
Brooklyn Apartment	12	< 0.1%
Loft Suite @ The Box House Hotel	11	< 0.1%
Private Room	11	< 0.1%
Artsy Private BR in Fort Greene Cumberland	10	< 0.1%
Private room	10	< 0.1%
Cozy Brooklyn Apartment	8	< 0.1%
Private room in Brooklyn	8	< 0.1%
Other values (46953)	47805	99.7%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
in	16604	5.7%
room	9944	3.4%
bedroom	7531	2.6%
	7279	2.5%
private	7132	2.5%
apartment	6648	2.3%
cozy	4946	1.7%
apt	4533	1.6%
brooklyn	4037	1.4%
studio	3814	1.3%
Other values (12451)	217980	75.0%

Most occurring characters

Value	Count	Frequency (%)
	182	100.0%

Most occurring categories

Value	Count	Frequency (%)
Control	182	100.0%

Most frequent character per category

Control

Value	Count	Frequency (%)
	182	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	182	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
	182	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	182	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
	182	100.0%

host_id
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	37325
Distinct (%)	77.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	66366719.84

Minimum	2438
Maximum	274321313
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	2438
5-th percentile	797420
Q1	7598992.25
median	29863220.5
Q3	104497453
95-th percentile	242478115.2
Maximum	274321313
Range	274318875
Interquartile range (IQR)	96898460.75

Descriptive statistics

Standard deviation	78126572.85
Coefficient of variation (CV)	1.177195031
Kurtosis	0.2838830002
Mean	66366719.84
Median Absolute Deviation (MAD)	26616062
Skewness	1.246626958
Sum	3.180691415 × 10¹²
Variance	6.103761385 × 10¹⁵
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
12243051	96	0.2%
16098958	96	0.2%
61391963	91	0.2%
22541573	87	0.2%
200380610	65	0.1%
1475015	52	0.1%
7503643	52	0.1%
120762452	50	0.1%
205031545	49	0.1%
2856748	49	0.1%
Other values (37315)	47239	98.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2438	1	< 0.1%
2571	1	< 0.1%
2787	6	< 0.1%
2845	2	< 0.1%
2868	1	< 0.1%
2881	2	< 0.1%
3151	1	< 0.1%
3211	1	< 0.1%
3415	1	< 0.1%
3563	1	< 0.1%

Value	Count	Frequency (%)
274321313	1	< 0.1%
274311461	1	< 0.1%
274307600	1	< 0.1%
274298453	1	< 0.1%
274273284	1	< 0.1%
274225617	1	< 0.1%
274195458	1	< 0.1%
274188386	1	< 0.1%
274103383	1	< 0.1%
274079964	1	< 0.1%

host_name
Categorical

HIGH CARDINALITY

Distinct	11425
Distinct (%)	23.8%
Missing	0
Missing (%)	0.0%
Memory size	2.9 MiB

Michael	417
David	402
John	293
Alex	278
Daniel	226
Other values (11420)	46310

Length

Max length	35
Median length	6
Mean length	6.073592622
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	6883 ?
Unique (%)	14.4%

Sample

1st row	Morgan
2nd row	Julio
3rd row	Amy
4th row	Rachel
5th row	Jennifer

Common Values

Value	Count	Frequency (%)
Michael	417	0.9%
David	402	0.8%
John	293	0.6%
Alex	278	0.6%
Daniel	226	0.5%
Sarah	226	0.5%
Maria	204	0.4%
Jessica	202	0.4%
Mike	193	0.4%
Andrew	190	0.4%
Other values (11415)	45295	94.5%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
	1120	2.1%
and	622	1.2%
michael	460	0.9%
david	448	0.8%
john	336	0.6%
alex	329	0.6%
laura	292	0.5%
maria	244	0.5%
daniel	242	0.5%
sarah	239	0.4%
Other values (10237)	48970	91.9%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

neighbourhood_group
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.7 MiB

2	20852
1	20041
3	5574
0	1087
4	372

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2
2nd row	1
3rd row	2
4th row	1
5th row	2

Common Values

Value	Count	Frequency (%)
2	20852	43.5%
1	20041	41.8%
3	5574	11.6%
0	1087	2.3%
4	372	0.8%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
2	20852	43.5%
1	20041	41.8%
3	5574	11.6%
0	1087	2.3%
4	372	0.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

neighbourhood
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	221
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	106.9792806

Minimum	0
Maximum	220
Zeros	42
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	0
5-th percentile	13
Q1	51
median	94
Q3	178
95-th percentile	214
Maximum	220
Range	220
Interquartile range (IQR)	127

Descriptive statistics

Standard deviation	68.8965507
Coefficient of variation (CV)	0.6440177046
Kurtosis	-1.264789579
Mean	106.9792806
Median Absolute Deviation (MAD)	60
Skewness	0.2562315228
Sum	5127089
Variance	4746.734698
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
214	3910	8.2%
13	3704	7.7%
94	2635	5.5%
28	2451	5.1%
202	1934	4.0%
95	1883	3.9%
64	1832	3.8%
201	1766	3.7%
51	1560	3.3%
127	1489	3.1%
Other values (211)	24762	51.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	42	0.1%
1	4	< 0.1%
2	21	< 0.1%
3	77	0.2%
4	889	1.9%
5	17	< 0.1%
6	65	0.1%
7	140	0.3%
8	6	< 0.1%
9	2	< 0.1%

Value	Count	Frequency (%)
220	200	0.4%
219	1	< 0.1%
218	11	< 0.1%
217	88	0.2%
216	157	0.3%
215	1	< 0.1%
214	3910	8.2%
213	40	0.1%
212	11	< 0.1%
211	2	< 0.1%

latitude
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	18984
Distinct (%)	39.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	40.72879618

Minimum	40.49979
Maximum	40.91306
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	40.49979
5-th percentile	40.645715
Q1	40.68961
median	40.72278
Q3	40.7633075
95-th percentile	40.826025
Maximum	40.91306
Range	0.41327
Interquartile range (IQR)	0.0736975

Descriptive statistics

Standard deviation	0.05487824725
Coefficient of variation (CV)	0.001347406562
Kurtosis	0.122347916
Mean	40.72879618
Median Absolute Deviation (MAD)	0.03655
Skewness	0.2423492754
Sum	1951968.286
Variance	0.003011622021
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
40.71813	18	< 0.1%
40.69414	13	< 0.1%
40.68444	13	< 0.1%
40.68634	13	< 0.1%
40.71353	12	< 0.1%
40.68537	12	< 0.1%
40.71171	12	< 0.1%
40.76189	12	< 0.1%
40.71923	11	< 0.1%
40.7191	11	< 0.1%
Other values (18974)	47799	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
40.49979	1	< 0.1%
40.50641	1	< 0.1%
40.50708	1	< 0.1%
40.50868	1	< 0.1%
40.50873	1	< 0.1%
40.50943	1	< 0.1%
40.51133	1	< 0.1%
40.52211	1	< 0.1%
40.52293	1	< 0.1%
40.527	1	< 0.1%

Value	Count	Frequency (%)
40.91306	1	< 0.1%
40.91234	1	< 0.1%
40.91169	1	< 0.1%
40.91167	1	< 0.1%
40.90804	1	< 0.1%
40.90734	1	< 0.1%
40.90527	1	< 0.1%
40.90484	1	< 0.1%
40.90406	1	< 0.1%
40.90391	1	< 0.1%

longitude
Real number (ℝ)

HIGH CORRELATION

Distinct	14578
Distinct (%)	30.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-73.95160063

Minimum	-74.24442
Maximum	-73.71299
Zeros	0
Zeros (%)	0.0%
Negative	47926
Negative (%)	100.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	-74.24442
5-th percentile	-74.0028575
Q1	-73.98242
median	-73.95526
Q3	-73.93583
95-th percentile	-73.8645225
Maximum	-73.71299
Range	0.53143
Interquartile range (IQR)	0.04659

Descriptive statistics

Standard deviation	0.04616488066
Coefficient of variation (CV)	-0.0006242580319
Kurtosis	5.066036523
Mean	-73.95160063
Median Absolute Deviation (MAD)	0.02466
Skewness	1.281648255
Sum	-3544204.412
Variance	0.002131196206
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-73.95427	18	< 0.1%
-73.95677	18	< 0.1%
-73.95405	17	< 0.1%
-73.95136	16	< 0.1%
-73.9506	16	< 0.1%
-73.95332	16	< 0.1%
-73.94791	16	< 0.1%
-73.95725	15	< 0.1%
-73.94537	15	< 0.1%
-73.98439	15	< 0.1%
Other values (14568)	47764	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-74.24442	1	< 0.1%
-74.24285	1	< 0.1%
-74.24084	1	< 0.1%
-74.23986	1	< 0.1%
-74.23914	1	< 0.1%
-74.23803	1	< 0.1%
-74.23059	1	< 0.1%
-74.21238	1	< 0.1%
-74.21017	1	< 0.1%
-74.20941	1	< 0.1%

Value	Count	Frequency (%)
-73.71299	1	< 0.1%
-73.7169	1	< 0.1%
-73.71795	1	< 0.1%
-73.71829	1	< 0.1%
-73.71928	1	< 0.1%
-73.72173	1	< 0.1%
-73.72179	1	< 0.1%
-73.72247	1	< 0.1%
-73.72435	1	< 0.1%
-73.72581	1	< 0.1%

room_type
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.7 MiB

0	24614
1	22156
2	1156

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2
2nd row	1
3rd row	0
4th row	0
5th row	1

Common Values

Value	Count	Frequency (%)
0	24614	51.4%
1	22156	46.2%
2	1156	2.4%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	24614	51.4%
1	22156	46.2%
2	1156	2.4%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

price
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	587
Distinct (%)	1.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	142.7652422

Minimum	10
Maximum	1800
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	10
5-th percentile	40
Q1	69
median	105
Q3	175
95-th percentile	350
Maximum	1800
Range	1790
Interquartile range (IQR)	106

Descriptive statistics

Standard deviation	131.4182141
Coefficient of variation (CV)	0.9205196729
Kurtosis	29.28742523
Mean	142.7652422
Median Absolute Deviation (MAD)	45
Skewness	4.224543833
Sum	6842167
Variance	17270.747
Monotonicity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
150	2043	4.3%
100	2037	4.3%
50	1526	3.2%
60	1455	3.0%
200	1394	2.9%
75	1368	2.9%
80	1272	2.7%
65	1190	2.5%
70	1166	2.4%
120	1127	2.4%
Other values (577)	33348	69.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
10	17	< 0.1%
11	3	< 0.1%
12	4	< 0.1%
13	1	< 0.1%
15	6	< 0.1%
16	6	< 0.1%
18	2	< 0.1%
19	4	< 0.1%
20	33	0.1%
21	6	< 0.1%

Value	Count	Frequency (%)
1800	2	< 0.1%
1799	1	< 0.1%
1795	1	< 0.1%
1763	1	< 0.1%
1750	3	< 0.1%
1749	1	< 0.1%
1731	1	< 0.1%
1700	4	< 0.1%
1680	1	< 0.1%
1600	4	< 0.1%

minimum_nights
Real number (ℝ_≥0)

Distinct	100
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6.5220757

Minimum	1
Maximum	365
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	2
Q3	5
95-th percentile	30
Maximum	365
Range	364
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	16.10130951
Coefficient of variation (CV)	2.468740053
Kurtosis	219.5989898
Mean	6.5220757
Median Absolute Deviation (MAD)	1
Skewness	12.07727139
Sum	312577
Variance	259.2521678
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	12640	26.4%
2	11490	24.0%
3	7992	16.7%
30	3294	6.9%
4	3293	6.9%
5	3029	6.3%
7	2050	4.3%
6	749	1.6%
14	561	1.2%
10	482	1.0%
Other values (90)	2346	4.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	12640	26.4%
2	11490	24.0%
3	7992	16.7%
4	3293	6.9%
5	3029	6.3%
6	749	1.6%
7	2050	4.3%
8	130	0.3%
9	80	0.2%
10	482	1.0%

Value	Count	Frequency (%)
365	27	0.1%
364	1	< 0.1%
360	5	< 0.1%
354	1	< 0.1%
300	6	< 0.1%
299	1	< 0.1%
275	1	< 0.1%
270	2	< 0.1%
265	1	< 0.1%
250	1	< 0.1%

number_of_reviews
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	386
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	23.57901765

Minimum	0
Maximum	488
Zeros	9510
Zeros (%)	19.8%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	5
Q3	24
95-th percentile	115
Maximum	488
Range	488
Interquartile range (IQR)	23

Descriptive statistics

Standard deviation	44.30524514
Coefficient of variation (CV)	1.879011492
Kurtosis	16.28536397
Mean	23.57901765
Median Absolute Deviation (MAD)	5
Skewness	3.481772224
Sum	1130048
Variance	1962.954747
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	9510	19.8%
1	5122	10.7%
2	3408	7.1%
3	2487	5.2%
4	1970	4.1%
5	1592	3.3%
6	1333	2.8%
7	1160	2.4%
8	1103	2.3%
9	943	2.0%
Other values (376)	19298	40.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	9510	19.8%
1	5122	10.7%
2	3408	7.1%
3	2487	5.2%
4	1970	4.1%
5	1592	3.3%
6	1333	2.8%
7	1160	2.4%
8	1103	2.3%
9	943	2.0%

Value	Count	Frequency (%)
488	1	< 0.1%
480	1	< 0.1%
474	1	< 0.1%
467	1	< 0.1%
466	1	< 0.1%
459	1	< 0.1%
458	1	< 0.1%
454	1	< 0.1%
451	1	< 0.1%
448	1	< 0.1%

last_review
Date

Distinct	1763
Distinct (%)	3.7%
Missing	0
Missing (%)	0.0%
Memory size	374.5 KiB

Minimum	1976-01-01 01:00:00+00:00
Maximum	2019-07-08 00:00:00+00:00

Histogram

Histogram with fixed size bins (bins=50)

reviews_per_month
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	935
Distinct (%)	2.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.100549806

Minimum	0
Maximum	58.5
Zeros	9510
Zeros (%)	19.8%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.05
median	0.38
Q3	1.61
95-th percentile	4.33
Maximum	58.5
Range	58.5
Interquartile range (IQR)	1.56

Descriptive statistics

Standard deviation	1.599773144
Coefficient of variation (CV)	1.453612672
Kurtosis	43.67746979
Mean	1.100549806
Median Absolute Deviation (MAD)	0.38
Skewness	3.28091007
Sum	52744.95
Variance	2.559274112
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	9510	19.8%
0.02	911	1.9%
0.05	883	1.8%
1	876	1.8%
0.03	797	1.7%
0.16	661	1.4%
0.04	646	1.3%
0.08	593	1.2%
0.09	586	1.2%
0.06	572	1.2%
Other values (925)	31891	66.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	9510	19.8%
0.01	42	0.1%
0.02	911	1.9%
0.03	797	1.7%
0.04	646	1.3%
0.05	883	1.8%
0.06	572	1.2%
0.07	458	1.0%
0.08	593	1.2%
0.09	586	1.2%

Value	Count	Frequency (%)
58.5	1	< 0.1%
27.95	1	< 0.1%
20.94	1	< 0.1%
19.75	1	< 0.1%
17.82	1	< 0.1%
16.81	1	< 0.1%
16.03	1	< 0.1%
15.78	1	< 0.1%
15.32	1	< 0.1%
15.23	1	< 0.1%

calculated_host_listings_count
Real number (ℝ_≥0)

Distinct	43
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.397091349

Minimum	1
Maximum	96
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	2
95-th percentile	9
Maximum	96
Range	95
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	9.918211126
Coefficient of variation (CV)	2.919618611
Kurtosis	54.33235713
Mean	3.397091349
Median Absolute Deviation (MAD)	0
Skewness	6.988563317
Sum	162809
Variance	98.37091194
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=43)

Value	Count	Frequency (%)
1	32182	67.1%
2	6641	13.9%
3	2843	5.9%
4	1436	3.0%
5	840	1.8%
6	558	1.2%
8	416	0.9%
7	399	0.8%
9	234	0.5%
10	210	0.4%
Other values (33)	2167	4.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	32182	67.1%
2	6641	13.9%
3	2843	5.9%
4	1436	3.0%
5	840	1.8%
6	558	1.2%
7	399	0.8%
8	416	0.9%
9	234	0.5%
10	210	0.4%

Value	Count	Frequency (%)
96	192	0.4%
91	91	0.2%
87	87	0.2%
65	65	0.1%
52	104	0.2%
50	50	0.1%
49	98	0.2%
47	47	0.1%
43	43	0.1%
39	39	0.1%

availability_365
Real number (ℝ_≥0)

ZEROS

Distinct	366
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	109.8798564

Minimum	0
Maximum	365
Zeros	17464
Zeros (%)	36.4%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	41
Q3	217
95-th percentile	359
Maximum	365
Range	365
Interquartile range (IQR)	217

Descriptive statistics

Standard deviation	130.3937594
Coefficient of variation (CV)	1.186693937
Kurtosis	-0.9174765325
Mean	109.8798564
Median Absolute Deviation (MAD)	41
Skewness	0.8067430482
Sum	5266102
Variance	17002.5325
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	17464	36.4%
365	1233	2.6%
364	468	1.0%
1	401	0.8%
89	358	0.7%
5	340	0.7%
3	306	0.6%
179	297	0.6%
90	285	0.6%
2	269	0.6%
Other values (356)	26505	55.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	17464	36.4%
1	401	0.8%
2	269	0.6%
3	306	0.6%
4	233	0.5%
5	340	0.7%
6	244	0.5%
7	218	0.5%
8	233	0.5%
9	193	0.4%

Value	Count	Frequency (%)
365	1233	2.6%
364	468	1.0%
363	228	0.5%
362	160	0.3%
361	107	0.2%
360	100	0.2%
359	131	0.3%
358	175	0.4%
357	89	0.2%
356	75	0.2%

month
Real number (ℝ_≥0)

ZEROS

Distinct	12
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.316404457

Minimum	0
Maximum	11
Zeros	2086
Zeros (%)	4.4%
Negative	0
Negative (%)	0.0%
Memory size	374.5 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	4
median	5
Q3	6
95-th percentile	10
Maximum	11
Range	11
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	2.403657632
Coefficient of variation (CV)	0.4521209121
Kurtosis	0.3200809153
Mean	5.316404457
Median Absolute Deviation (MAD)	1
Skewness	0.07051643411
Sum	254794
Variance	5.777570012
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
6	13390	27.9%
4	12243	25.5%
5	5920	12.4%
8	4635	9.7%
0	2086	4.4%
2	1760	3.7%
1	1658	3.5%
10	1534	3.2%
11	1528	3.2%
7	1268	2.6%
Other values (2)	1904	4.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2086	4.4%
1	1658	3.5%
2	1760	3.7%
3	756	1.6%
4	12243	25.5%
5	5920	12.4%
6	13390	27.9%
7	1268	2.6%
8	4635	9.7%
9	1148	2.4%

Value	Count	Frequency (%)
11	1528	3.2%
10	1534	3.2%
9	1148	2.4%
8	4635	9.7%
7	1268	2.6%
6	13390	27.9%
5	5920	12.4%
4	12243	25.5%
3	756	1.6%
2	1760	3.7%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	id	name	host_id	host_name	neighbourhood_group	neighbourhood	latitude	longitude	room_type	price	minimum_nights	number_of_reviews	last_review	reviews_per_month	calculated_host_listings_count	availability_365	month
0	21671	17437106	Couch in Harlem Harvey Refugees only	33511962	Morgan	2	94	40.81302	-73.95349	2	10	1	0	1976-01-01 01:00:00+00:00	0.00	1	0	4
1	47181	35642891	Beautiful room in Bushwick	268138154	Julio	1	28	40.69640	-73.91898	1	10	1	2	2019-06-18 00:00:00+00:00	2.00	1	0	6
2	23227	18835820	Quiet, Cozy UES Studio Near the Subway	52777892	Amy	2	201	40.76844	-73.95341	0	10	3	10	2018-10-22 00:00:00+00:00	0.39	1	0	10
3	32774	25839759	Gigantic Sunny Room in Park Slope-Private Backyard	167570251	Rachel	1	190	40.66242	-73.99464	0	10	1	14	2018-10-28 00:00:00+00:00	1.06	1	4	10
4	22258	17979764	Jen Apt	84497333	Jennifer	2	178	40.72237	-73.99817	1	10	5	2	2017-04-15 00:00:00+00:00	0.07	1	0	0
5	33189	26235873	Voted #1 Airbnb In NYC	197169969	Maria	3	105	40.68939	-73.79886	0	10	2	22	2019-07-06 00:00:00+00:00	1.76	1	332	5
6	22232	17952277	Newly renovated, fully furnished room in Brooklyn	62685070	Katie	1	28	40.69974	-73.91935	1	10	5	0	1976-01-01 01:00:00+00:00	0.00	1	0	4
7	33469	26496645	Room with a view	110049861	Martin	1	214	40.70959	-73.95693	1	10	1	0	1976-01-01 01:00:00+00:00	0.00	1	83	4
8	31031	24114389	Very Spacious bedroom, steps from CENTRAL PARK.	180661875	Salim	2	202	40.76844	-73.98333	1	10	1	2	2018-04-23 00:00:00+00:00	0.13	1	0	0
9	2857	1620248	Large furnished 2 bedrooms- - 30 days Minimum	2196224	Sally	2	64	40.73051	-73.98140	0	10	30	0	1976-01-01 01:00:00+00:00	0.00	4	137	4

Last rows

	df_index	id	name	host_id	host_name	neighbourhood_group	neighbourhood	latitude	longitude	room_type	price	minimum_nights	number_of_reviews	last_review	reviews_per_month	calculated_host_listings_count	availability_365	month
47916	13702	10314411	Ultra-Modern 6-bedroom House (Great for Groups)	4393578	Jack	2	34	40.74234	-74.00032	0	1731	10	84	2019-03-31 00:00:00+00:00	2.80	2	97	7
47917	48498	36311055	Stunning & Stylish Brooklyn Luxury, near Train	245712163	Urvashi	1	13	40.68245	-73.93417	0	1749	1	0	1976-01-01 01:00:00+00:00	0.00	1	303	4
47918	40049	31120563	Magnificent 5 Bedroom Brooklyn Townhouse	9786357	Ilsa	1	158	40.68187	-73.97075	0	1750	2	5	2019-07-01 00:00:00+00:00	1.65	1	358	5
47919	46103	35109246	Bedroom in heart of Cobble Hill BK w/ private roof	88988332	Dorothea	1	43	40.68929	-73.99656	1	1750	30	0	1976-01-01 01:00:00+00:00	0.00	1	179	4
47920	46858	35481836	Duplex Residence with Breathtaking NYC View!	232557023	NuAve	2	75	40.73942	-73.98648	0	1750	7	0	1976-01-01 01:00:00+00:00	0.00	1	178	4
47921	7084	5131879	Large, comfy 1br in Williamsburg!	26529661	Alexis	1	214	40.71270	-73.94643	0	1763	60	0	1976-01-01 01:00:00+00:00	0.00	1	0	4
47922	24964	20016493	ART LOFT/HOME: DINNERS, GATHERINGS, PHOTO	142118455	Allan	2	144	40.72560	-73.99487	0	1795	1	38	2019-06-21 00:00:00+00:00	1.65	1	116	6
47923	43526	33718046	Prime Location!Cozy 2BR in West Village!	253192168	Romeo	2	209	40.73037	-74.00497	0	1799	2	0	1976-01-01 01:00:00+00:00	0.00	1	270	4
47924	14357	11234747	Mins away to Manhattan Suite Residence	24146326	Julien	3	4	40.76626	-73.93054	2	1800	3	5	2017-04-09 00:00:00+00:00	0.13	2	90	0
47925	45854	34997894	entire apartment for rent	263670476	Algerchaabi	1	7	40.63360	-74.02884	0	1800	30	0	1976-01-01 01:00:00+00:00	0.00	1	335	4

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Control

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

First rows

Last rows